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ABSTRACT 


The  object  of  this  study  is  to  find  an  approximation  to  the  discrete 
optimal  Kalman  filter  gain  schedule  by  closed-form  analytic  expressions. 
In  doing  so,  required  table  storage  and/or  on-line  computation  time  can 
be  reduced  at  little  expense  in  terms  of  filter  performance  degradation. 
The  method  of  least  squares  was  used  to  determine  the  closed-form  solution 
which  was  the  best  fit  to  the  discrete  Kalman  filter  gain  schedule.   The 
criterion  for  performance  degradation  was  the  difference  between  the  val- 
ues of  the  diagonal  elements  of  the  estimation  covariance  matrix,  P,  ,,  , 
obtained  by  using  the  Kalman  gain  schedule,  and  the  corresponding  values 
obtained  by  using  the  closed-form  analytic  expressions  for  the  elements 
of" the  gain  matrix.   Examples  are  presented  to  show  that  near-optimal 
results  were  obtained  utilizing  this  method.   A  comparison  of  the  results 
of  this  study  with  another  near-optimal  estimation  scheme  is  also  included, 
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LAPLACE  DEFINITIONS 
f(t)  =  1_1  [(sI-A)"1] 


ret)  =  A-1 


|(s)  +  B 


l_   s 


I.   INTRODUCTION 

The  theory  of  optimal  estimation  has  undergone  considerable  investi- 
gation in  recent  years  [_»»»>  J  •   The  objective  of  estimation  is  the 
production,  in  some  optimal  way,  of  estimates  of  the  state  vector,  which 
is  denoted  by  x  ,  from  some  set  of  observations,  denoted  by  z^ .   In  the 
early  1960's,  R.  E.  Kalman  initiated  a  new  formulation  of  the  Wiener 
filter  theory  expressing  the  results  in  the  time  domain  rather  than  the 
frequency  domain  L  '  ' J  . 

The  vector  dynamic  case  of  the  linear  filtering  equation  can  be 
stated  by 


-k/k   ~  k/k-1  +  Gk  [-\  ~  %k-l] 


(1) 


where  x,  .,  is  the  estimate  of  x.  .   Kalman  found  that  the  optimal  estimate 
-^k/k  — k 

x  .  ,  in  a  minimum-variance  sense,  could  be  obtained  by  solving  the  dif- 
~1c/k 


ference  equations 


G.  =  P  , 
k    k/k- 


/K/k-/  +  R]  -1  (2) 


\/k '  (I-GH)pk/k-i  (3> 

pk+i/k  ■  |pk/kiT  +  Q  (4) 

with  PQ  ,  ,  -  VAR  Txq  -  x~|    and  x^  =  E  PxA   The  definitions  and  dimen- 
sions of  the  matrix  quantities  in  the  above  equations  may  be  found  in  the 
Table  of  Symbols  and  Abbreviations. 

It  is  obvious  that,  in  order  to  solve  for  successive  values  of  x  ,, 
in  equation  (1),  it  is  necessary  to  solve  equations  (2),  (3),  and  (4) 


recursively.   This  process  involves  a  considerable  number  of  matrix  mani- 
pulations.  Consequently  the  on-line  computation  time  would  be  large.   Also 
considerable  storage  space  would  be  needed  if  the  problem  were  to  be  redone 
at  a  later  time,  utilizing  the  same  matrix  of  gains.   This  estimation 

scheme  requires  the  implementation  of —   difference  equations 

or  an  n   order  system  of  which  — are  non-linear.   For  large-order 

systems,  this  scheme  may  be  of  such  complexity  that  it  is  undesirable  for 
a  given  application. 

If  it  were  possible  to  derive  an  analytic  closed-form  expression  which 
would  approximate  the  optimal  Kalman  filter  gain  schedule  with  acceptable 
degradation  of  filter  performance  then  on-line  computation  time  would  be 
greatly  decreased  since  no  matrix  manipulations  would  be  necessary.   Also, 
the  need  for  table  storage  of  the  gains,  G,  ,  would  not  be  necessary  since 
it  would  be  a  simple  matter  to  calculate  them  again  when  they  were  needed. 


II.   THEORY 

Appendix  A  illustrates  that,  according  to  the  criterion  of  least 
squares,  the  best  fit  curve  to  a  set  of  data  is  one  in  which  the  sum  of 
the  squares  of  the  errors  of  the  points  is  a  minimum.   The  method  used  to 
obtain  this  best  fit  curve  is  known  as  the  Method  of  Least  Squares. 

If  this  method  can  be  used  to  produce  a  curve  which  is  the  best  fit, 
in  a  least-squares  sense,  to  the  set  of  optimal  gains,  then  the  equation 
for  that  curve  would  be   a  sub-optimal  closed-form  solution  for  those 
gains. 

Therefore,  all  that  is  necessary  to  produce  a  candidate  closed-form 
analytical  approximation  for  the  optimal  Kalman  filter  gain  schedule  is 
to  fit  a  least  squares  curve  to  the  set  of  optimal  gains. 

Observations  of  typical  optimal  Kalman  filter  gain  schedules  indi- 
cated that  these  gains  would  most  likely  be  best  fit  with  exponential 
curves.   In  order  to  take  advantage  of  existing  computer  programs  on  least- 
squares  curve-fitting  it  is  necessary  to  convert  the  exponential  form  to 
a  linear  form.   Appendix  A  illustrates  the  method  by  which  this  transfor- 
mation was  made.   Once  the  transformation  to  a  linear  form  has  been  made 
the  method  of  least-squares  curve-fitting  can  be  applied  and  the  results, 
through  an  inverse  transformation,  can  be  used  to  obtain  the  desired  ex- 
ponential expressions. 

Equations  (2),  (3),  and  (4)  reveal  that  the  solution  for  the  optimal 
gain  matrix  depends  on  the  quantities  P^/i  ■■»  H,  R,  $  and  Q  where 

Q  »   TNTT  (5) 

and  N  is  the  random  force  covariance  associated  with  the  particular  prob- 
lem.  The  definitions  and  dimensions  of  these  quantities  may  be  found  in 


the  Table  of  Symbols  and  Abbreviations.   In  order  to  reduce  the  complexity 
of  the  system,  for  that  is  the  basic  goal  of  this  study,  some  simplifying 

assumptions  are  made.   It  is  necessary  to  initialize  the  prediction  co- 
variance  matrix  IY/k-1  •   The  diagonal  elements  of  this  matrix  indicate 
the  confidence  given  to  the  initial  filter  state  vector.   It  will  be  as- 
sumed that  little  confidence  is  given,  thus  the  diagonal  elements  of 
P_,_,  will  be  large.   The  off -diagonal  elements  indicate  to  what  extent 
the  initialization  errors  of  the  filter  states  are  dependent.   It  will  be 
assumed  that  they  are  independent  and  thus  the  off-diagonal  terms  of 
P  ,   will  be  zero. 

It  is  also  assumed  that  the  measurement  matrix,  H,  the  state  trans- 
mission matrix,  $,  and  the  P  matrix,  which  is  used  to  compute  the  co- 
variance  of  perturbation  matrix,  Q,  are  constant  for  a  given  plant.   That 
is  to  say  that  once  these  quantities  are  known  for  a  specific  process  or 
plant,  they  remain  unchanged  during  the  operation  of  the  plant  or  process. 

Thus,  once  the  nature  of  the  plant  or  process  is  known,  the  only 
variables  involved  in  the  determination  of  the  optimal  gain  matrix  are  the 
measurement  noise  variance,  R,  and  the  random  force  variance,  N.   These 
quantities  will  be  assumed  constant  in  time  for  a  given  problem,  but  may 
vary  from  problem  to  problem. 

With  these  assumptions  it  is  possible  to  develop  closed-form  expres- 
sions for  the  elements  of  the  gain  matrix  in  terms  of  the  quantities  R 
and  N. 
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III.   PROCEDURE 

As  stated  above  the  object  of  this  study  is  to  develop  a  method  for 
finding  a  sub-optimal  closed-form  analytic  expression  for  the  optimal 
Kalman  filter  gain  schedule  which  would  be  easier  to  implement  and  reduce 
required  table  storage  and/or  on-line  computation  time  while  keeping  fil- 
ter degradation  to  a  minimum. 

The  best  way  to  present  the  method  of  this  study  is  to  follow  an 
illustrative  example  which  demonstrates  the  technique  used  to  obtain  the 
desired  results.   Note  that  this  method  is  designed  to  be  used  with  a 
plant  or  process  which  has  a  known,  non-variable  configuration,  with  the 
only  variables  being  the  measurement  noise  variance,  R,  and  the  random 
force  variance,  N. 

The  problem  discussed  for  purposes  of  demonstration  will  be  one  where 
the  motion  of  a  mass  particle  in  one  dimension  is  considered.   The  ob- 
server will  initialize  the  problem  by  indicating  when  he  sees  the  particle 
pass  a  zero  point.   Subsequent  measurements  of  the  particle's  position 
will  be  made  at  a  period  of  T  seconds  as  measured  by  a  clock.   The  filter 
then  must  produce  minimum  variance  estimates  of  the  particle's  position 
and  velocity  at  discrete  times  kT  where  k  i  0. 

The  system  state  variables  chosen  were  position  and  velocity.   The 
vector  matrix  form  of  the  state  equations  can  be  expressed  as 


i  ■  [si]  4M f . 


Assuming  that  the  random  forcing  function,  f,  is  piecewise  constant,  and 
recalling  the  definitions  of  |(T)  and  P (T)  given  in  the  Table  of  Symbols 
and  Abbreviations,  the  solution  of  equation  (6)  is  given  by 


11 


where 


2k  + 1  -  K +  r  jsk +  »k] 


(7) 


(8) 


and 


T(T)  =  1/M 


(9) 


Since  only  measurements  of  position  are  made  the  measurement  matrix  is 
given  by 


E  -  [l   0]  . 


(10) 


From  equation  (5)  the  covariance  of  perturbation  matrix,  Q,  is  given  by 


Q  - 


N/  o 


I4  I3 
4   2 

2  T 


(11) 


Next  the  problem  must  be  initialized.   Assuming  that  the  observer 
signals  when  he  thinks  that  the  particle  is  initially  at  a  position  zero 
and  also  assuming  his  guess  of  the  particle's  velocity  to  be  10.0  units/ 
sec,  the  filter's  initial  state  vector  is 


A 

X 

-0 


l-i    Lio.oJ  , 


(12) 


As  discussed  above,  when  initializing  the  prediction  covariance  matrix 
it  is  necessary  to  consider  how  much  confidence  is  given  to  the  values  of 
the  observer's  eye-sight  and  reflexes  as  well  as  his  ability  to  estimate 
the  particle's  initial  velocity.   Being  distrustful  of  his  ability  the 
initial  covariance  matrix  becomes 


12 


riot 


,'100   0 
°/~1  100 


(13) 


The  diagonal  elements  indicate  the  lack  of  confidence  in  the  initialization 
of  the  state  vector  of  equation  (12). 

Assuming  a  value  of  unity  for  the  mass  of  the  particle,  values  of  R 
and  N  may  be  chosen  and  the  optimal  gain  schedule  for  the  Kalman  filter 
may  be  found  using  equations  (2)  through  (4). 

The  problem  to  be  considered  now  is  how  to  achieve  a  closed-form 
analytic  approximation  for  G,  so  that  equation  (1)  may  be  solved  to  ob- 
tain estimates  of  x.  . 
— k 

Before  going  further  a  quantity  to  be  known  as  the  pseudo  signal-to- 
noise  ratio  of  the  system  must  be  defined.   This  signal-to-noise  ratio 
is  defined  as  N/R  where 


N  =  E 


and 


[\4_ 


M]  . 


(14) 


R  =  E  v,  vM  (15) 


To  make  this  signal-to-noise  ratio  a  scalar  quantity  it  must  be  stipu- 
lated that  the  random  measurement  noise  signal,  v  ,  and  the  random  fore- 

ing  function,  w  ,  are  scalar  quantities  for  this  problem.   Thus  the  quan- 
k 

tity  N/R  is  a  scalar  measurement  of  the  signal-to-noise  ratio  of  the 
system. 

The  example  problem,  with  initial  conditions  as  shown  above,  was  run 
for  various  values  of  the  signal-to-noise  ratio  N/R.   Fig.  1  and  Fig.  2 
show  a  family  of  curves  for  the  gain  matrix  elements  G(l,l)  and  G(2,l) 
repsectively  and  the  associated  signal-to-noise  ratio  of  each.   As  stated 
earlier  it  was  decided  that  the  points  of  G(l,l)  could  best  be  approxi- 
mated by  the  sum  or  difference  of  two  exponentials.   Using  the  method 

13 


illustrated  in  Appendix  A  of  reducing  an  exponential  to  linear  form  it 
was  a  simple  matter  to  take  the  logarithms  of  the  points  and  obtain  a  least- 
squares  fit  curve  for  each  set  of  points.   The  curves  obtained  as  well  as 
the  equations  for  these  curves  are  found  in  Fig.  1  and  Fig.  2. 

Steady-state  gain  as  a  function  of  signal-to-noise  ratio  is  plotted 
in  Fig.  3.   These  plots  indicate  that  the  steady-state  gains  also  behave 
in  an  exponential  manner  with  respect  to  the  signal-to-noise  ratio.   Fur- 
ther investigation  showed  that  the  exponents  of  the  equations  in  Fig.  1 
and  Fig.  2  behave  in  a  like  manner.   Using  the  same  method  as  discussed 
above,  closed-form  solutions  for  these  quantities  were  developed  in  terms 
of  the  signal-to-noise  ratio  N/R.   The  analytical  closed-form  solution 
and  its  related  equations  are  called  the  sub-optimal  equations.   These 
appear  in  equations  (4.1)  through  (4.9)  of  Appendix  B. 
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IV.   RESULTS 

Once  the  closed-form  analytic  approximation  for  the  gain  matrix,  G  , 
is  found  it  is  an  easy  matter  to  test  the  results  against  the  recursive 
equations  of  the  optimal  Kalman  filter.   Since  the  Kalman  filter  gains  are 
optimum  in  a  minimum-variance  sense  it  is  necessary  only  to  compare  the 
diagonal  elements  of  the  P  .  matrix  obtained  using  the  closed-form  sol- 
ution for  G.  with  the  respective  elements  of  the  P,  ,,  matrix  obtained 
k  v  k/k 

using  the  optimal  Kalman  filter  gain  schedule. 

Since  the  gains  obtained  from  the  solution  of  the  closed-form  equa- 
tions are  non-optimal,  equation  (3)  may  not  be  used.   Instead  it  is  ne- 
cessary to  derive  a  general  equation  for  all  values  of  P  ,,  obtained  with 
other  than  optimal  gains.   Such  an  equation  has  been  derived L^J  which  can 
be  expressed  as 

pk/k  -  pk/k-rGklffk/k-iHlGk +  Gk(HPk/k-i«T  +  *»Gl  .  <*> 

Figures  4  and  5  show  the  comparison  of  the  diagonal  elements  of  P  . 
for  the  optimal  case  and  those  for  the  case  where  G,  was  determined  by 
the  closed-form  expressions  developed.   These  figures  indicate  that  the 
values  obtained  using  sub-optimal  gains  are  higher  than  the  optimal  val- 
ues.  To  determine  how  much  this  difference  affects  the  estimation  capa- 
bilities of  the  filter  this  problem  was  simulated  and  a  comparison  was 
made  between  the  actual  value  of  velocity  for  the  point  and  the  estimated 
value  of  velocity  for  both  the  optimal  and  sub-optimal  case.   Figure  6 
indicates  that,  for  this  problem,  the  estimating  capabilities  of  the 
optimal  and  sub-optimal  filters  are  similarly  effective. 
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V.   COMPARISON  OF  RESULTS  WITH  A  PREVIOUS  STUDY 

Sims  and  Melsa*-  -•  have  reported  on  attempts  to  achieve,  for  the  con- 
tinuous case,  near-optimal  estimation  using  a  structure  which  is  easier 
to  implement  than  the  optimal  Kalman  solution.   Their  method,  called 
Specific  Optimal  Estimation,  is  described  in  Ref .  13.   The  following  is 
an  attempt  to  adapt  their  methods  and  results  for  the  continuous  case  to 
the  discrete  case. 

A.   THE  DISCRETE  LINEAR  PROBLEM 

Consider  the  linear  message  model 


x    =  fx.  +  rV  (17) 

-k+1   *-k     -k 


with  observation  model 


z,  =  Hx,  +  v  (18) 

-k    -k   nc 


where  u  and  v  are  white  noise  processes  such  that 


(19) 


E|V|  =EIXI 


=  o 


A 


The  optimal  linear  minimum  variance  estimate,  x    ,  Qf  the  state 

Hc/k 


vector  x,  is  given  by 

— k 


x    —  x  .    +  G    z.  -z,  .,  ,  I 
-k/k   -k/k-1    k  L-k  -k/k-lj 


(20) 
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where 


-iHT[Hpk/k-iHT  +  R]_1  (21> 


G  -  P 
k    k/k 


and  Pi/,  is  the  solution  to  the  matrix  difference  equations 


pk/k  -  (1-GH)pk/k-i  <22> 


Pk+l/k  =  |pk/k^T  +  Q  <») 


and  po/-i  -  VAR  [V^o]  ;    5o-E[2o3 


It  is  proposed  in  this  paper,  to  find  an  estimate  x     of  x     having 
the  same  form  as  equation  (20),  but  with  the  gain  matrix,  G,  ,  constrained 
to  be  of  a  specific  configuration.   In  particular,  G,  is  assumed  to  be 
the  solution  to  the  difference  equation 


Gk  =  F(k,a)    GQ  -  D  (24) 

where  a  is  a  constant-parameter  vector  to  be  determined  optimally  and  D 
is  a  matrix  of  initial  conditions  which  may  or  may  not  be  determined  opti- 
mally. 

Let  x.  ■  x, -x,  ,  be  the  estimation  error,  and  assume  that  the  obser- 
-k   -k  -k/k 

vation  interval  be  discrete.   The  error  criterion  used  is 

T 


J  -  i       E  [  ||5)|  2]  (25) 


This  may  be  written  as 


LeM  . 


T 
tr      t 


Making  use  of   the  definition 


■"[SI1] 


Pk/k.E|x^  (27) 
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equation  (26)  can  be  written 


T 


J  =  tr  t       P  (28) 

k  =  1   k/k   . 


The  problem  then  is  to  determine  the  parameters  in  the  equation  of  G, 
such  that  J  is  minimized.   If  it  is  assumed  that  the  estimate,  Xwb-'  ^s 
of  the  form  specified  in  equation  (20)  it  is  easy  to  verify  that  P^/i,  satis- 
fies the  difference  equation 

Pk/k  "  Pk/M-^HP^^Gj  +  G^HP^,^  +  R)G£  ^         (29) 

Sims  and  Melsa  determined  the  parameters  in  the  equation  for  G,  which 
minimized  equation  (28)  by  developing  the  Hamiltonian  for  Pu/vj  deter- 
mining the  equations  for  the  Lagrange  multiplier  matrices,  and  obtaining 
the  solution  by  solving  the  problem  as  a  two-point  boundary  problem  with 
appropriate  boundary  conditions. 

Since  the  equation  for  Pwir  is  a  difference  equation,  in  the  discrete 
case,  rather  than  a  differential  equation,  this  approach  cannot  be  used. 
One  might  solve  equation  (29)  recursively  with  equation  (4)  for  all  val- 
ues of  k  in  the  summation,  and  set  the  derivative  with  respect  to  the 
undetermined  parameters  of  G  equal  to  zero  to  determine  the  gains  which 
would  minimize  equation  (28) ,  but  an  inspection  of  this  method  by  the 
author  revealed  that  this  would  be  too  tedious.   The  approach  adopted 
here,  although  being  equally  tedious,  lent  itself  to  a  computer  solution. 
This  approach  involved  setting  the  gain  matrix  to  a  constant  in  equation 
(29)  and  evaluating  the  cost  function  of  equation  (28) .   One  element  of 
the  gain  matrix  was  held  constant  and  the  other  was  varied  until  a  mini- 
mum value  for  J  was  found.   The  element  of  the  gain  matrix  which  had 
been  held  constant  was  then  incremented  and  the  procedure  was  duplicated. 
As  a  result  Fig.  9  was  obtained.   The  verticle  lines  are  proportional  to 
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the  value  of  the  cost  function  at  each  local  minimum  shown.   The  coordi- 
nates of  the  base  of  each  verticle  line  are  the  values  of  G(l,l)  and  G(2,l) 
which  gave  the  value  of  the  cost  function  shown.   The  values  of  gain  at 
which  the  cost  function  reached  its  absolute  minimum  were  G(l,l)  =  .852 
and  G(2,l)  =  .466.   These  are  compared  with  the  optimal  steady-state  val- 
ues of  G(l,l)  =  .700  and  G(2,l)  =  .400.   Using  the  values  of  gain  obtained 
above  the  illustrative  problem  was  run  and  the  results  are  presented  in 
graphic  form  in  Fig.  4  and  Fig.  5. 

Note  that  the  gains  obtained  above  were  close  to  the  steady-state 
values  of  the  optimal  gain  matrix.   It  would  be  expected  that  these  gains 
would  become  closer  to  the  optimal  steady-state  values  as  the  number  of 
samples  increases.   To  show  this  the  solution  was  performed  again  for  ten 
samples,  vice  twenty.   The  values  of  the  gain  matrix  for  minimum  cost  ob- 
tained were  G(l,l)  ■  .902  and  G(2,l)  =  .516.   Thus,  with  a  smaller  number 
of  samples,  the  sub-optimal  constant  gains  are  further  from  the  steady- 
state  optimal  gains. 
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VI.   CONCLUSIONS 

It  is  evident  from  Fig.  4  through  Fig.  6  that  the  Kalman-type  filter 
utilizing  the  closed-form  equations  for  sub-optimal  gains  performs  in  a 
near-optimal  manner  with  little  degradation  in  the  performance  of  the 
filter.   The  question  now  arises  as  to  whether  this  method  of  determining 
the  filter  gains  does  fulfill  the  objective  of  this  study;  that  is,  has 
required  table  storage  and/or  on-line  computation  time  been  reduced?  A 
comparison  of  equations  (4.1)  and  (4.2)  of  Appendix  B  with  equation  (2) 
above  indicates  that  the  former  equations  are  easily  and  quickly  solved 
for  all  values  of  k,  once  the  signal-to-noise  ratio,  N/R,  is  determined, 
while  in  the  latter  equation  it  is  necessary  to  perform  four  matrix  pro- 
ducts, two  transposes,  and  a  matrix  inversion  in  order  to  solve  for  one 
value  of  the  gain  matrix.   In  order  to  solve  this  equation  for  all  values 
of  k  it  is  necessary  to  solve  equations  (3)  and  (4)  recursively  along  with 
equation  (2).   This  procedure  requires  four  additional  matrix  products, 
an  additional  matrix  transpose,  and  a  matrix  addition  and  subtraction  in 
order  to  obtain  each  additional  value  for  the  gain  matrix.   Thus  the 
closed-form  gain  equations  will  greatly  reduce  on-line  computation  time. 

This  same  argument  can  be  used  to  show  that  required  table  storage 
has  also  been  reduced.   Assume,  for  instance,  that  a  problem  is  to  be 
performed  over  again  at  a  later  time,   In  the  case  of  the  Kalman  filter 
it  is  necessary  to  store  the  gain  schedule,  since  it  would  be  too  costly 
in  on-line  computation  time  to  re-compute  the  schedule.   Since  the  closed- 
form  equations  are  much  more  quickly  solved  it  is  not  necessary  to  store 
the  values  of  gain  obtained  in  this  manner. 
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Recall  that  it  has  been  assumed  that  all  factors  which  influence  the 
gain  matrix  are  to  be  constant  from  problem  to  problem,  with  the  exception 
of  the  scalar  measurement-noise  covariance,  R,  and  the  scalar  random-force 
covariance,  N.   These  quantities  were  assumed  constant  for  a  single  prob- 
lem but  could  change  from  problem  to  problem.   Suppose  now  that  one  or 
both  of  these  quantities  changed  during  the  problem,  say  at  time  k  equal 
to  ten.   The  optimal  gain  schedule  for  such  a  system  might  be  as  shown  in 
Fig.  7.   In  a  situation  such  as  this  the  Kalman  gain  schedule  would  have 
to  be  computed  on-line  to  maintain  optimality  if  the  change  time  were  not 
known  a  priori.   In  Fig.  8  a  plot  is  shown  of  the  reaction  of  the  closed- 
form  approximations  to  such  a  situation.   Although  the  sub-optimal  gains 
are  still  non-optimal,  they  follow  the  general  trend  of  the  optimal  gains, 
and  hence  may  be  used  in  their  stead. 

The  arguments  presented  above  would  indicate  that  substantial  savings 
in  time  and  space  could  be  realized  at  little  cost  in  performance  if  the 
closed-form  approximations  for  the  gain  matrix  were  used  in  place  of  the 
Kalman  recursive  solution. 

An  inspection  of  Fig.  A  and  Fig.  5  reveals  that  the  results  obtained 
by  the  specific  optimal  estimation  technique  offered  by  Sims  and  Melsa 
are  more  near-optimal  than  those  obtained  by  the  method  discussed  in  this 
paper.   This  fact  brings  out  the  major  difference  between  these  two  methods 
In  this  study  the  gain  matrix  was  constrained  to  be  an  exponential,  the 
parameters  of  which  were  determined  by  geometric  means.   That  is,  the 
parameters  of  the  exponential  were  determined  by  requiring  that  the  ex- 
ponential be  a  geometric  least-squares  fit  to  the  Kalman  filter  optimal- 
gain  matrix.   In  contrast  the  parameters  of  the  constant-gain  matrix  of 
the  specific  optimal  estimator  were  determined  by  minimizing  errors  in 
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filter  performance.   It  is  significant  to  note  that  the  constant  gains 
employed  in  the  Sims/Melsa  method  gave  better  performance  than  the  ex- 
ponential gains  of  the  geometric  fit  method.   One  might  speculate  that  the 
assumption  of  an  exponential  form  in  the  former  method  might  even  more 
closely  match  the  optimal  filter  performance. 
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VII.   SUMMARY 

This  study  has  illustrated  that  a  closed-form  analytic  approximation 
to  the  filter  gain  matrix  for  an  optimal  Kalman  filter  can  be  obtained 
which  will  reduce  the  computation  time  while  procuding  near-optimal  esti- 
mates.  This  method  would  be  useful  in  problems  where  computation  time  and 
storage  space  were  limited.   This  method  has  compared  favorably  with  both 
the  optimal  filter  and  the  specific  optimal  estimator  with  which  it  was 
compared. 
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APPENDIX  A 
METHOD  OF  LEAST  SQUARES 

The  most  probable  value  of  a  quantity  which  is  obtained  from  a  set  of 
observations  is  the  one  which  corresponds  to  the  most  probable  set  of 
errors  of  observation.   These  errors  are  known  as  residuals.   Consider 
a  set  of  n  observations  of  equal  precision,  the  mose  probable  errors  of 
which  are  x..  ,  X2 ,  x_,...x  ,  respectively.   Since  the  probability  of  the 
simultaneous  occurrence  of  several  events  in  a  series  is  the  product  of 
their  individual  probabilities,  and  the  probability  of  an  error,  x,  is 


h    -h  x 
P  =K     e 


(2.1) 


it  follows  that  the  probability  of  the  simultaneous  occurrence  of  the 

errors  Xi  ,  xi,  Xo,...x  will  be 
-1-  J     n 


P  = 


h  -h2x2 
*f6    1 


b  e-h2x2' 


that  is 


P  = 


h 


n     2,  2   2   2 
-h  (x  x  x 

e     12   3 


h  -h2x2 
fi   e    n 


,x2) 


(2.2) 


Since  h,  n,   ,  and  e  are  constants  in  a  given  problem  the  quantity  P  is 
a  maximum  when  the  exponent  of  e  is  a  maximum,  or  when  the  sum 


2   2   2    2   . 
x  x  x  . . .x   is  a  minimum. 
12   3    n 


(2.3) 


Thus,  the  most  probably  value  of  the  observed  quantity,  or  the  best  value, 
in  other  words,  obtainable  from  the  given  set  of  observations,  will  be  one 
for  which  the  sum  of  the  squares  of  the  residuals  is  a  minimum.   This  is 
called  the  Principle  of  Least  Squares. 
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The  Principle  of  Least  Squares  has  been  used  extensively  to  formulate 
computer  programs  for  determining  the  coefficients  of  a  linear  equation 
which  is  a  best  fit,  in  the  Least-Square  sense,  to  observed  data.   In 
general,  equations  of  higher  than  first  degree  can  be  reduced  to  linear 
form  by  developing  the  function  by  Taylor's  Theorem  and  neglecting  the 
squares,  products,  and  higher  powers  of  the  small  increments  involved. 

Equations  in  which  the  unknown  constant  occurs  as  an  exponent  con- 
stitute a  special  case  of  reduction  to  linear  form.   In  brief,  the  method 
is  to  throw  the  equation  into  the  logarithmic  form  by  taking  the  logarithm 
of  each  member.   The  resulting  function  will  be  linear  with  respect  to 
the  desired  coefficient.   Suppose  the  function  is  of  the  form 

y  =  aebt  (2.4) 

in  which  a  and  b  are  to  be  determined  so  as  to  fit  all  to  the  observa- 
tions as  well  as  possible.   Taking  the  logarithm  of  each  member  gives 

log  y  =  log  a  +  bt,  (2.5) 

which  is  the  linear  form  of 

yf  -  A  +  bt,  (2.6) 

where  A  and  b  are  the  unknown  constants.   By  simply  taking  the  inverse 
logarithm  of  the  coefficient  A  the  Least  Squares  fit  curve  of  exponential 
form  can  be  obtained. 
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APPENDIX  B 
SUB-OPTIMAL  GAIN  EQUATIONS 


G(2,1K  =  Ae  *k  +  2e"^£^+  A  (4.1) 


G(l,l)k  =  Ce  *k  +  D  (4.2) 


ratio  =  N/R  (4.3) 


-.4325  n     .. 

E  =  e  : —  (4  .4) 

ratio 

.6841 

D  =  e— —  (4.5) 

ratio 


A  =  2  -  E  (4.6) 


C  =  1  -  D  (4.7) 


2e-.5383(ratio) 


_.7382 
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